DFNet: Enhance Absolute Pose Regression with Direct Feature Matching
نویسندگان
چکیده
We introduce a camera relocalization pipeline that combines absolute pose regression (APR) and direct feature matching. By incorporating exposure-adaptive novel view synthesis, our method successfully addresses photometric distortions in outdoor environments existing photometric-based methods fail to handle. With domain-invariant matching, solution improves accuracy using semi-supervised learning on unlabeled data. In particular, the consists of two components: Novel View Synthesizer DFNet. The former synthesizes views compensating for changes exposure latter regresses poses extracts robust features close domain gap between real images synthetic ones. Furthermore, we an online data generation scheme. show these approaches effectively enhance estimation both indoor scenes. Hence, achieves state-of-the-art by outperforming single-image APR as much 56%, comparable 3D structure-based methods. (The code is available https://code.active.vision .)
منابع مشابه
SPP-Net: Deep Absolute Pose Regression with Synthetic Views
Image based localization is one of the important problems in computer vision due to its wide applicability in robotics, augmented reality, and autonomous systems. There is a rich set of methods described in the literature how to geometrically register a 2D image w.r.t. a 3D model. Recently, methods based on deep (and convolutional) feedforward networks (CNNs) became popular for pose regression....
متن کاملMatching and Pose Reenement with Camera Pose Estimates Matching and Pose Reenement with Camera Pose Estimates
This paper describes novel algorithms that use absolute camera pose information to identify correspondence among point features in hundreds or thousands of images. Our incidence counting algorithm is a geometric approach to matching; it matches features by extruding them into an absolute 3-D coordinate system, then searching 3-D space for regions into which many features project. The absolute p...
متن کاملAbsolute pose estimation from line correspondences using direct linear transformation
This work is concerned with camera pose estimation from correspondences of 3D/2D lines, i.e. with the Perspective-n-Line (PnL) problem. We focus on large line sets, which can be efficiently solved by methods using linear formulation of PnL. We propose a novel method ‘DLT-Combined-Lines’ based on the Direct Linear Transformation (DLT) algorithm, which benefits from a new combination of two exist...
متن کاملA Lexical Analogy to Feature Matching and Pose Estimation
We relate the problem of finding a correspondence between sensed and model features to that of finding a match between a random set of letters and words in a dictionary. The process is equivalent to hashing and the lexical perspective illuminates items such as design tradeoffs, computational complexity, and hashing function definition. A method for two-dimensional pose estimation based on this ...
متن کاملLow Density Feature Point Matching for Articulated Pose Identification
We describe a general algorithm for identifying an arbitrary pose of an articulated subject with low density feature points. The algorithm aims to establish a one-to-one correspondence between two data point-sets, one representing the model of an observed subject and the other representing the pose taken from freeform motion of the subject. We avoid common assumptions such as pose similarity or...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2022
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-20080-9_1